Do not Bet on the Unknown Versus Try to Find Out More: Estimation Uncertainty and “Unexpected Uncertainty” Both Modulate Exploration
نویسندگان
چکیده
Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel hypothesis of exploration that helps reconcile prior findings that may seem contradictory at first. According to this hypothesis, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our hypothesis using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.
منابع مشابه
Joint Bayesian Stochastic Inversion of Well Logs and Seismic Data for Volumetric Uncertainty Analysis
Here in, an application of a new seismic inversion algorithm in one of Iran’s oilfields is described. Stochastic (geostatistical) seismic inversion, as a complementary method to deterministic inversion, is perceived as contribution combination of geostatistics and seismic inversion algorithm. This method integrates information from different data sources with different scales, as prior informat...
متن کاملDetermining production level under uncertainty using fuzzy simulation and bootstrap technique, a case study
In every production plant, it is necessary to have an estimation of production level. Sometimes there are many parameters affective in this estimation. In this paper, it tried to find an appropriate estimation of production level for an industrial factory called Barez in an uncertain environment. We have considered a part of production line, which has different production time for different kin...
متن کاملRisk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings
Recently, evidence has emerged that humans approach learning using Bayesian updating rather than (model-free) reinforcement algorithms in a six-arm restless bandit problem. Here, we investigate what this implies for human appreciation of uncertainty. In our task, a Bayesian learner distinguishes three equally salient levels of uncertainty. First, the Bayesian perceives irreducible uncertainty o...
متن کاملThe Effect of the Economic Uncertainty Index on the Stability of the Health of the Financial System
Background & Aims: Uncertainty is a state in which the knowledge of a person or persons is limited and full knowledge of the state or result that has been achieved or is not possible. Macroeconomic uncertainties create an uncertain environment for investors and make it impossible for investors to make decisions about future investments more efficiently and with more confidence, and they may suf...
متن کاملUncertainty Estimation in Stream Bed Sediment Fingerprinting Based on Mixing Model
Uncertainty associated with mixing models is often substantial, but has not yet been fully incorporated in models. The objective of this study is to develop and apply a Bayesian-mixing model that estimates probability distributions of source contributions to a mixture associated with multiple sources for assessing the uncertainty estimation in sediment fingerprinting in Zidasht catchment, Iran....
متن کامل